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© Television motion detection arrangement 



© In the arrangement, a television picture memory 
(MEM) containing digital picture signal values asso- 
ciated with picture elements (PIX) is coupled via a 
picture signal value comparison circuit (COM1) and 
an absolute value circuit (ABS1) to an adaptive 
threshold circuit (THR) for the picture signal differ- 
ences. In order to obtain a motion detection with a 
directional sensitivity in the horizontal and vertical 
direction, the threshold circuit (THR) has adaptive 
^-horizontal and vertical threshold value - adapting 
^circuit (ADA) which produces the adaptive threshold 



CO 



values (HI and VI) via maximum value passing cir- 



^cuits (H MAX and V MAX) which are coupled to the 
00 memory (MEM) via an absolute value circuit (ABS2), 
picture signal comparison circuit (COM2) and a 
signal combining circuit (AVE2) t and by-passing it. 
CO The comparison circuit (COM2) is operative for the 
q horizontal threshold value (HI) with picture elements 
in the line direction which are more or less adjacent 



LU 



to an instantaneous picture element and picture ele- 
ment values which are derived via the signal com- 
bining circuit (AVE2) from the picture elements of 



one of the more or less adjacent, superjacent or 
underlying lines belonging to the instantaneous, pre- 
ceding or subsequent field period. The comparison 
circuit (COM2) is operative for the vertical treshold 
value (VI) with picture elements in the field direction 
that are more or less adjacent to the instantaneous 
picture element and picture element values which 
are derived via the combining circuit (AVE2) from 
the picture elements of one of the more of less 
adjacent, superjacent or underlying lines belonging 
to the instantaneous, preceding or subsequent field 
period. 
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Television motion detection arrangement 



The invention relates to a television motion 
detection arrangement having at least one televi- 
sion picture store for storing digital picture signal 
values related to picture elements of an interlaced 
television picture which on display is formed line 
-sequentially or horizontally and field - sequentially 
or vertically, a frame period comprising several 
field periods, and further including a picture signal 
value comparison circuit whose inputs are coupled 
to at least outputs of the store containing the pic- 
ture signal values for producing picture signal value 
differences, to an absolute-value circuit coupled to 
outputs of the comparison circuit for supplying the 
picture signal value differences, to an adaptive 
threshold circuit coupled to outputs of the absolute- 
value circuit and to a threshold value-adapting cir- 
cuit an output of which is coupled to a threshold 
value input of the adaptive threshold circuit for the 
supply of a threshold value which depends on the 
picture signal value differences, exceeding the 
adaptive threshold value being an indication of mo- 
tion. 

Such a motion detection arrangement can be 
used for various purposes. In the event of a televi- 
sion transmission channel having a bandwidth 
which is more limited than that of the television 
signal source, the motion detection can be used for 
bandwidth reduction. In the conversion of a televi- 
sion signal from one standard to an other "the 
motion detection can be used to obtain an im- 
proved picture quality on display of the converted 
picture signal. In addition, the motion detection can 
be used during motion compensation for the case 
of a moving television camera. In all cases the 
detection can be combined with estimating the 
degree and/or the direction of the motion at a 
picture element of the television picture, consid- 
ered or not considered across sub-regions of the 
television picture which comprise several, sur- 
rounding picture elements. 

In all cases an appropriate detection whether 
there is motion or no motion in whatever degree or 
direction, is of basic importance. The adaptive 
structure of the threshold circuit results in known 
manner in an improved detection. Then, the ad- 
aptation can be effected on the basis of the picture 
signal value difference between an instantaneous 
picture element and the corresponding picture ele- 
ment one picture period earlier or earlier and later. 
However, at the occurrence of on the one hand 
details in the television picture having a high spatial 
frequency and on the other hand rapid motion 
corresponding to a high temporal frequency, it is 
still possible* that faulty decisions as regards mo- 
tion are taken, which, on display of the picture 



signal, results in an inpermissible loss in picture 
quality. In practice it has been found that a rapid 
motion transversely of a detail having a high spatial 
frequency may result in such a loss in quality. 

5 The invention has for its object to provide a 

motion detection arrangement with an optimum de- 
tection of whether there is motion or no motion in 
the cases described, its specific object being to 
prevent an incorrect motion detection. According to 

;o the invention, a television motion detection arrange- 
ment is characterized, in that the adaptive thresh- 
old circuit has at least a horizontal or vertical 
threshold-value input coupled to an output of a 
horizontal or vertical maximum-value pass circuit, 

rs respectively, which forms part of the threshold 
value-adapting circuit, inputs of which are coupled 
via an absolute-value circuit to outputs of a picture 
signal value comparison circuit which, via a signal 
combining circuit and by-passing this circuit, is 

20 coupled to outputs of the picture store, said last 
picture signal value comparison circuit being oper- 
ative for the horizontal maximum-value pass circuit 
with, relative to an instantaneous picture element, 
more or less adjacent picture elements in the line 

25 or horizontal direction and picture element values 
which are derived via the signal combining circuit 
from the picture elements of one of the more or 
less adjacent, superjacent or underlying lines be- 
longing to the instantaneous, preceding or subse- 

30 quent field period and also for the maximum-value 
pass circuit with, relative to the said instantaneous 
picture element, more or less adjacent picture ele- 
ments in the field or vertical direction and picture 
element values which are derived via the signal 

35 combining circuit from the picture elements of one 
of the more or less adjacent, superjacent or under- 
lying lines belonging to the instantaneous, preced- 
ing or subsequent field period. 

As a result thereof a directional sensitivity in 

40 the horizontal and vertical direction is introduced 
during the motion detection, which results in a 
more accurate detection whether there is motion or 
no motion. 

The invention will now be described in greater 
45 detail by way of example with reference to the 
accompanying drawings, in which 

Fig. 1 is a block circuit diagram of an em- 
bodiment of a television motion detection arrange- 
ment according to the invention, 
so Fig. 2 is a further block circuit diagram of a 

detection arrangement operative with a preceding 
and a subsequent television field or picture, re- 
spectively, 
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Fig. 3 shows, to explain the mode of opera- 
tion of the arrangement, five television lines a. b, c, 
d and e during five field periods VT, 

Figs. 4a and 4b show three picture elements 
1, 2 and 3 of each television line b, c and d of Fig. 
3. 

Figs. 5a and 5b illustrate the derived values 
of the adaptive horizontal and vertical threshold 
value, respectively, 

Figs. 6a, 6b and 6c show some picture ele- 
ments c and interpolated picture elements 1/2- 
[a2 + c2] and 1/2[c2 + e2] during three field periods 
VT1, VT3 and VT5, 

Fig. 7 has for its object to give an illustration 
of a manner in which a conclusion can be made 
that there is indeed motion or no motion, respec- 
tively, via the adaptive horizontal and vertical 
threshold value, 

Fig. 8 is a further block circuit diagram for a 
detection arrantement operating with three fields (t 
- 1), (t) and (t +• 1) having single interlace, 

Fig. 9 is a different block circuit diagram 
associated with a mode of an operation with three 
fields (t - 2), (t) and (t + 2), the treshold value- 
adapting circuit being operative with only the in- 
stantaneous field (t), 

Fig. 10 shows three picture elements 0. 2 
and 4 of each television line a, c and e of Fig. 3, 
and 

Figs. 11, 12 and 13 show in mutually .com- 
parable ways television lines and picture elements 
by way of illustration of possible treshold value 
adaptations having more or less adjacent picture 
elements. 

In the embodiment of a television motion de- 
tection arrangement according to the invention, 
shown in a block circuit diagram in Fig. 1, refer- 
ence MEM denotes a television picture memory. In 
single-interlaced television, in which a television 
frame period comprises two field periods, the 
memory MEM may comprise two field memories. 
Three field memories may be provided when the 
information about a television picture is obtained 
from two field memories, whilst the third field mem- 
ory is being written, in the case of a motion detec- 
tion based on a preceding and a subsequent televi- 
sion picture relative to an instantaneous field of 
picture elements, four or five field memories may 
then be present in the memory MEM. For this 
situation Fig. 2 shows a detection arrangement 
having four field memories MEM11, MEM12, 
MEM13 and MEM14, each having a time delay of 
one field period VT. Independent of the number of 
field memories in the memory MEM, this memory 
is assumed to be a digital memory, to which a 
digitised picture signal PS is applied via an 8-bit 
input. The picture signal PS is assumed to be 



assembled line-sequentially or horizontal and field- 
sequentially or vertical in known manner, which on 
display provides an interlaced television picture. In 
this situation, the television picture consists of pic- 
5 ture elements for which corresponding storage ele- 
ments are denoted by PIX at the memory MEM. in 
addition, H indicates the horizontal or line direction 
and V indicates the vertical or' field direction, t 
representing time. 
io In known manner, multiple outputs of the mem- 

ory MEM are coupled to inputs of a picture signal 
value comparison circuit C0M1. In addition, the 
memory MEM and the circuit COM1 are coupled 
via a signal combining circuit AVE1, which, as will 
75 be described hereinafter, is designed as an 
average-value circuit Independent on the structure 
of the memory MEM, the comparisons are effected 
in the circuit COM1, for an instantaneous picture 
element PIX, the picture signal value being com- 
20 pared with, for example, the corresponding picture 
element PIX of the preceding or the subsequent 
television picture, it further being possible that 
more of fewer adjacent, surrounding picture ele- 
ments are involved in the comparison. TG in Fig. 1 
25 denotes a time signal generator for applying, for 
example, clock pulses to the memory MEM, the 
circuit COM1 and circuits still further to be de- 
scribed hereinafter. For simplicity of the drawing, 
the connections from the time signal generator TG 
30 to the different components of the arrangement are 
omitted. The drawing shows that the inputs of the 
circuit COM1 are coupled to outputs of the mem- 
ory MEM, but the input carrying the picture signal 
PS can directly be connected to the circuit COM1 . 
35 The circuit COM1 is followed by an absolute- 

value circuit ABS1. The circuit ABS1 applies the 
positive and negative picture signal value differ- 
ences, originating from the circuit C0M1, with the 
same, fixed polarity to an adaptive threshold circuit 
40 THR. The circuit THR has in known manner a 
threshold value-input Ol coupled to an output of the 
threshold vaiue-adapting circuit ADA. The threshold 
value, which is alternatively denoted as Ol, de- 
pends on the magnitude of the picture signal value 
45 differences and exceeding the threshold value re- 
sults in motion being detected. For each element 
PIX the circuit THR provides, in an output signal 
MOT, the information that motion is detected or not 
detected, respectively, which is represented by, for 
so example a logic 1 or a logic 0, respectively. This 
information can be obtained not only via the 
element-to-element comparison described but also 
by means of a comparison with surrounding picture 
elements, for example in a predetermined sub- 
55 region of the television picture. The degree of 
motion and its direction could moreover be deter- 
mined. Independent of the specific implementation 
of the motion detection together with its degree 
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and or direction, the circuit THR is further provided, 
in accordance with a feature of the invention, with a 
horizontal and a vertical threshold value input HI 
and VJ. respectively, to which corresponding out- 
puts of the threshold value-adapting circuit ADA are 
connected. By way of example, the drawing shows 
8-bit inputs Ol, Hi and VI, the respective threshold 
values having been given the same indications. 

The threshold value-adapting circuit ADA in 
accordance with the invention is provided, as is 
shown in Fig. 1, with a signal combining circuit 
AVE2. constituted, for example by an average- 
value circuit, coupled to the memory MEM. Out- 
puts of the memory MEM are coupled via the 
circuit AVE2 and by-passing it to inputs of a picture 
signal value comparison circuit COM2, which is 
followed by an absolute-value circuit ABS2. The 
circuit ABS2 is shown as having three groups of 
outputs which are coupled via maximum-value pass 
circuits V MAX, H MAX and O MAX to the respec- 
tive threshold value inputs VI, HI and Ol. 

To explain how the arrangement shown in Fig. 
1 operates, five field periods are denoted in Fig. 3 
by VT1 to VT5. inclusive, five interlaced television 
lines are denoted by a. b. c, d and e. VT3 denotes 
an instantaneous field period by (t). the times (t-1) 
and (t-2) belonging to the two preceding field 
periods VT2 and VT1 and the times (t + 1) and 
(t + 2) belonging to the two subsequent .field 
periods VT4 and VT5. As was also the case for the 
memory MEM of Fig. 1, V denotes the vertical 
direction. Let it be assumed in this situation in Fig. 
3 that the memory MEM comprises four or five 
field memories for supplying the picture signals 
belonging to the five field periods. Fig. 2 relates to 
the design having four memories constituted by 
delay devices. 

In Figs. 4a and 4b three picture elements are 
shown for each television line b, c and d of Fig. 3 
denoted by 1 , 2 and 3. The instantaneous picture 
element is represented by c2(t) and a square. The 
adjacent picture elements in the horizontal direction 
are denoted by c1(t) and c3(t). The adjacent pic- 
ture elements in the vertical direction are denoted 
by b2(t-1) and d2(M) in Fig.4a and by b2(t + 1) and 
d2(t + l) in Fig. 4b. Picture elements of the super- 
jacent and underlying line corresponding to the 
picture element c1(t) and c3(t), are denoted by b1, 
b3 and dl, d3, respectively, more specifically for 
the preceding field (t-1) and the subsequent field 
(t + 1). 

Figs. 5a and 5b are associated with the deriva- 
tion of the adaptive horizontal and vertical threshold 
value, respectively, for the fields (t) and (t-1 ) or (t) 
and (t+1). The horizontal threshold value is ob- 
tained via the circuit H MAX. ABS2, COM2 and 
AVE2 in accordance with the following relation: the 
maximum of 



|c2(t)-d(t)|, 
|c2(t) - c3(t)|, 

|c2(t) - 1/2 (b1(M) + d1(t-1))| and 
|c2(t) - 1/2 (b3(M) + d3(t-1))| 

5 is allowed to pass, wherein | | denotes the ab- 
solute value, the minus sign is part of the compari- 
son and 1/2(.. + ..) is part of the picture element 
combination, here in the form of taking an average 
value. Replacing (t-1) by (t+ 1) provides the relation 

to for the subsequent field instead of the preceding 
field. In Fig. 5a the influence of the value averaging 
operation is illustrated by means of the broken 
lines. It was found that the horizontal maximum- 
value pass circuit H MAX is operative with, relative 

75 to the instantaneous picture element c2(t), adjacent 
picture elements c1(t) and c3(t) in the horizontal 
direction and picture elements corresponding 
thereto which are derived by means of the signal 
combining circuit AVE2 from the respective picture 

20 elements b1 and b3 of the superjacent line and d1 
and d3, respectively of the underlying line, belong- 
ing to the preceding (t-1) or the subsequent (t + 1) 
field period. 

The vertical threshold value is obtained in ac- 
25 cordance with the following relation: the maximum 
of 

|c2(t)-b2(t-1)| 
|c2(t)-d2(t-1)| 

|c2(t) - 1/2(b1(M) + b3(M))| and 

30 |c2(t) - 1/2(d1(t-1) + 1))| 

is passed. Also here (t-1) may be replaced by 
(t + 1 ). In Fig. 5b the influence of the value averag- 
ing operating is illustrated by the broken lines. It 
was found that the vertical maximum-value pass 

35 circuit V MAX is operative, relative to the instanta- 
neous picture element c2(t), with adjacent picture 
elements b2 and d2 and picture elements cor- 
responding thereto which are derived by means of 
the signal combining circuit AVE2 from the picture 

40 elements preceding them in the same lines, b1 and 
d1 , respectively, and which follow in the same line, 
b3 and d3, respectively, the said picture elements 
being part of the preceding (t-1) or subsequent 
(t + 1 ) field period. 

45 For the sake of completeness, it should be 

noted that the circuit O MAX allows the maximum 
to pass of the absolute values of the picture value 
differences between the instantaneous picture ele- 
ment c2(t) and each of the surrounding picture 

so elements b, c and d. 

The use at the threshold values HI and VI of 
the directional sensitivity in the horizontal and verti- 
cal direction, results in practice in a more accurate 
decision in the detection whether there is indeed 

55 motion. The direction-sensitive threshold values are 
then, for example, superimposed on a minimum 
threshold value which is determined by the noise 
level. 
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A still further measure consists in that, in the 
presence of the adaptive horizontal and vertical 
threshold value HI and VI, respectively, the thresh- 
old circuit THR is provided with a gate circuit 
having a logic AND-function so that the detection 
there is motion is only obtained if the absolute 
values of all the picture signal value differences 
applied for the instantaneous picture element c2(t), 
exceed one of the threshold values (01, HI and VI). 
in Fig. 1 an AND-gate is shown by way of illustra- 
tion at the output of the threshold circuit THR. Figs. 
6a, 6b and 6c relate to three field periods VT1 (t-2), 
VT3(t) and VT5(t + 2) Fig. 6b shows the instanta- 
neous picture element c2 in the form of a square. 
The field which, as is shown in Fig. 6a occurs two 
field periods VT earlier and the field which, as is 
shown in Fig. 6c occurs two field periods VT later, 
are represented by the picture elements c1, c2 and 
c3» picture elements obtained by interpolation or 
signal averaging by the circuit AVE1 being denoted 
by 1/2(a2 + c2] and 1/2tc2 + e2]. The said 
(interpolated) picture elements are represented in 
Fig. 7 by circles. For the fields (t) and (t-2) it is 
decided that there is indeed motion if the following 
logic AND-relation applies: 
|c2(t) - c1(t-2)|> HI 
AND |c2(t) - c3(t-2)|> HI 
AND |c2(t) - 1/2{a2 + c2} (t-2)|> VI 
AND (c2(t) - 1/2{c2 + e2} (t-2)|> VI 
AND |c2(t) - c2 (t-2) |> Ol 

For the fields (t) and (t + 2) it is necessary that in 
the AND-relation (t-2) is replaced by (t + 2). 

On the basis of the above AND-relation, the 
conclusion that motion is indeed detected is only 
taken on very good grounds since ail the picture 
signal value differences applied for the instanta- 
neous picture element c2(t) to the circuit THR by 
the circuit C0M1 must exceed one of the threshold 
values Hi, VI and Ol. 

The arrangement shown in Fig. 1 is operative 
with preceding or subsequent field and frame 
periods. Fig. 2 shows an arrangement which is 
operative with preceding and subsequent field and 
frame periods. The input carrying the picture signal 
PS is coupled to the series arrangement of four 
memories MEM11 to MEM 14, inclusive, which act 
as delay devices, each producing a time delay 
equal to the field period VT. Starting from the 
instantaneous field (t) the two preceding fields (t-1 ) 
and (t-2) and the two subsequent fields (t + 1) and 
(t + 2) are simultaneously available for processing. 
PR0C11 and 12, respectively, denote a signal pro- 
cessing circuit comprising the circuits AVE1, 
C0M1, ABS1 and THR of Fig. 1. PR0C13 and 14, 
respectively, is a signal processing circuit compris- 
ing the circuits AVE2, COM2, ABS2, O MAX, H 
MAX and V MAX. PROC 13 and 14, respectively is 
operative with the fields (t). (t+1) and (t), (t-1), 



respectively, as described for Fig. 2. A respective 
output M0T1 and 2 carrying the decision that mo- 
tion is detected (logic 1) or that no motion is 
detected (logic 0) is coupled to an input of a logic 

5 OR-gate, denoted by OR, an output M0T12 carry- 
ing the ultimate decision whether motion is indeed 
detected or not. 

In the manner described the arrangement is of 
a dual construction, the coupling of the compo- 

?o nents of a dual construction (PROC1 1 + PROC1 3) 
and (PROC12 + PROC14) results in practice in a 
more accurate detection because of the logic OR- 
function for obtaining the indication that motion is 
indeed detected (logic 1). In the event in which the 

is detection that there is indeed motion corresponds 
to the logic 0 the logic OR-function can be realised 
by replacing the OR-gate by a NAND-gate. 

Fig. 8 is a block circuit diagram of a detection 
device which is operative with three fields, as is 

20 indicated by three field periods (t-1), (t) and (t+1). 
Components already described with reference to 
Figs. 1 and 2 are given the same reference nu- 
merals in Fig. 8 and in the subsequent Fig. 9. Fig. 
8 shows two memories MEM12 and MEM13, the 

25 signal processing circuits PROC being operative 
with the following fields (t-1), (t) and (t+1): 
PR0C11 and PROC 12 with fields (t-1) and (t+1). 
PR0C13 with fields (t) and (t + 1) and PROC14 with 
fields (t-1) and (t). The output MOT1 operates via a 

30 memory MEM15 as a delay device having a time 
delay equal to 2 VT, coupled to the gate OR. 
Instead of the memories MEM11 and MEM14 of 
Fig. 2, the memory MEM15 is used in accordance 
with Fig. 8. This provides a cheaper construction as 

35 the memories MEM 11 (VT) and MEM14 (VT) suit- 
able for storing and supplying the digitized picture 
signal PS are replaced by the memory MEM15 (2 
VT) which has a more limited storage capacity and 
is suitable for storing and supplying the information 

40 that there is indeed (logic 1) and no motion detec- 
tion (logic 0), respectively. 

The use of the memory MEM15 results in that 
the detection device of Fig. 8 operates with the 
preceding and the subsequent field period. By way 

45 of illustration and by way of example let it be 
assumed that on processing of the field sequence 
(t-1) = 3, 4 etc. and (t + 1) = 5, 6, etc. the outputs 
MOT2 and MOT1 carry motion information about 
the fields 3, 5 and 4 f 6, respectively, etc. and the 

so memory MEM15 supplies the motion information 
about the respective fields 1, 3 and 3, 4, etc. It 
appears that the field 3 and 4, respectively, etc. is 
compared to the fields 1, 5 and 2, 6, respectively 
etc. 

55 Fig. 9 is a block circuit diagram of a detection 

device operative with three fields (t-2), (t) and 
(t + 2) t the threshold value -adapting circuit ADA- 
(PROC13, PROC14) being operative with only the 
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